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(54) Editing of recorded material 

(57) An edit controller tor controlling editing of re- 
corded audio and/or video material, in which temporally 
successive material clips of a edited output material se- 
quence are represented by corresponding clip icons on 
a display screen, comprises cursor control means for 
providing user control of a cursor on the display screen; 
selection control means for selecting an operation to be 
performed by the edit controller in dependence on the 
current position of the cursor on the display screen when 
the selection control means is activated by the user; 
means for defining first and second display screen se- 
lection areas for each clip icon, the first and second dis- 
play screen selection areas each having a predefined 



position on the display screen with respect to a current 
display position of the respective clip icon; means, re- 
sponsive to user operation of the selection control 
means white the cursor is displayed within the first se- 
lection area associated with a clip Icon for initiating re- 
play of the output material sequence from the start of 
the material clip c?Orrespondtng to that clip icon; and 
means, responsive to user operation of the selection 
control means while the cursor is displayed within the 
second selection area associated with a clip icon for in- 
itiating replay of the output material sequence from a 
point within the material clip corresponding to that clip 
icon which Is a predetermined time before the end of 
that material clip. 
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Description 

This invention relates to the editing of recorded material (such as audio or video material) and to edit controllers 
such as audio and/or video edit controllers. 

As an example, video edit controllers are used to edit a number of *'raw" source video sequences into a final 
programme or part of a programme. For example, a short news story may contain brief excerpts of a number of different 
video sequences, possibly including newly captured and older, archived sequences, in order to illustrate different as- 
pects of the news story. A relevant portion or "clip" of each sequence needs to be selected, and the selected portions 
linked together to form the composite output sequence. 

Recently, computer-based non-linear edit controllers have become available. These allow a user to view the source 
sequences on a computer screen and to select an "in-point" and an "out-point" for each required sequence using the 
computer keyboard or a cursor control device such as a mouse, joystick or trackerball. 

An example of a display screen for such an edit controller is shown schematically in Figure 1 of the accompanying 
drawings. 

In Figure 1 , a number of source video sequences are stored either on video tape or in a computer-based storage 
device such as a hard disk. The source sequences are registered with the edit controller, for example by the user 
indicating where on a video tape that source sequence can be found, or simply by the sequence being copied into the 
computer-based storage device. The source video sequences are then represented by source icons 20 in an upper 
area of the display screen. These source video sequences are then all available for editing by the user 

A viewer window 10 is provided for viewing a currently selected source (or output) video sequence. To view a 
source video sequence the user simply selects the corresponding source icon, for example by double-clicking (using 
a mouse cursor control device) on the icon. That source sequence can then be viewed in the viewer window, under 
the control of simulated video tape recorder controls such as play, stop, rewind etc. 

When a portion of a source video sequence is selected by the user specifying an in-point and an out-point, that 
portion is represented in a lower, output area of the screen by a clip icon 30. In contrast to the source icons described 
above, where the order of display on the display screen simply related to the order in which the source sequences 
were registered or loaded, the order of the output icons 30 is important. In particular, the order (from left to right) of the 
icons on the screen represents the order in which the corresponding portions of video sequences will be replayed to 
for the output edited sequence. 

Thus, in the example of Figure 1 , if the user double-clicks on the clip icon 30Af then the whole of the portion A will 
be displayed, followed immediately by the whole of the portion B, then C and finally D. The composite sequence ABCD 
fornr^ the edited output programme. 

If the user wishes to preview only, say, a latter part of the edited output programme, he could double-click on the 
clip icon 30C, in which case replay would start from the beginning of clip C, to be followed immediately by clip D. 

This invention provides an edit controller for controlling editing of recorded audio and/or video material, in which 
temporally successive material clips of a edited output material sequence are represented by corresponding clip icons 
on a display screen, the controller comprising: 

cursor control means for providing user control of a cursor on the display screen; 

selection control means for selecting an operation to be performed by the edit controller in dependence on the 
current position of the cursor on the display screen when the selection control means is activated by the user; 
means for defining first and second display screen selection areas for each clip icon, the first display screen se- 
lection area haying a predefined position on the display screen with respect to a current display position of the 
respective clip icon and the second display screen selection area having a predefined position with respect to a 
current display position of the respective clip icon and/or the next clip icon in the temporal replay order; 
means, responsive to user operation of the selection control means while the cursor is displayed within the first 
selection area associated with a clip icon for initiating replay of the output material sequence from the start of the 
material clip corresponding to that clip icon; and 

means, responsive to user operation of the selection control means while the cursor is displayed within the second 
selection area associated with a clip icon for initiating replay of the output material sequence from a point within 
the material clip corresponding to that clip icon which is a predetermined time before the end of that material clip. 

The invention recognises that a previously proposed edit controller in which successive output material clips are 
represented by corresponding screen icons has limitations when the user wishes to review the edited output rr^teriai 
sequence. 

For example, while replay from the start of one of the output clips cgn be controlled as described above, if the user 
wishes to review just the join or edit point between two successive clips, then in the previously proposed system he 
would have had either to (a) initiate replay from the start of the preceding clip and wait until the end of that clip; or (b) 
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use a jog or similar control to replay just the closing seconds of the preceding clip. Both of these techniques are 
inconvenient for the user, who may be under time pressure to work efficiently (e.g. in a news-gathering editing envi- 
ronment). 

The invention addresses this technical problem of providing means tor reviewing the edit transition between suc- 
5 cessive clips, by providing two distinct controls associated with each clip icon. If the selection control means (e.g. a 
mouse button, trackerball button or joystick button) is operated when the cursor is in a first area associated with a clip 
icon, the whole of the corresponding clip is replayed. However, if the cursor is in a second area associated with that 
icon, only the closing seconds (or other predetermined amount) of the clip is replayed. In both cases, replay can then 
continue to temporally succeeding clips. 
10 Thus, by using the second area associated with an icon (which may be, for example, at the right hand edge of 

each icon, between that icon and the temporally following icon or at the left hand edge of the temporally following icon), 
the user can preview the edit transition from a point just before the end of that clip. 

The system is particularly convenient to use if the icons are arranged in temporal order along a predetermined 
screen direction (e.g. from left to right). 
'5 Preferably the predetermined time may be set by the user. 

The invention will now be described by way of example with reference to the accompanying drawings, throughout 
which like parts are referred to by like references, and in which: 

Figure 1 is aschematic diagram of a display screen of an edit controller; 
'^'^ Figure 2 is a schematic block diagram of an edit controller and associated video storage apparatus; 

FiLjuicb 3rt to 3c schematically illustrate source video files; 
Figure 3d schematically illustrates an edited output video sequence; 

Tiqurcs 4rt to 4c schematically illustrate the logical relationship between clip icons, an edit decision list and data 
fcpfcscnitng source Video files; 
* - ^ iquf c 5 schematically illustrates cursor mapping within an output area of the display screen of Figure 1 ; 

f^iquro 6 scnomatically illustrates a second type of cursor mapping within the output area of the display screen of 

/ (Qurc 1 

iqurc, 7rf tc 7c schematically illustrate different cursor types during a drag and drop operation; 
P iqiiro'; f^n Hnd 8b Schematically illustrate the use of the different cursor types; 
:^ P trjijrr C4 schematically illustrates a shuttle control operation in a viewer windSw of the display screen of Figure 1 ; 

rind 

Figure 10 IS a schematic graph of shuttle speed against cursor displacement. 

Figure 1 IS a schematic diagram of a display screen of an edit controller The display screen will be described first 
35 \o give an overview of the edit controller operation, and then the hardware and software underlying this will be described 
further In (rict much of Figure 1 has already been described above. 

The fcolay operation described above (initiated by clicking on the viewer window) can be stopped by a single 
mDusc click within the viewer window. The viewer window can also be used to control shuttle operation, in a manner 

10 be described further below. 

-to i: IS possible for the user to re-order the clip icons to rearrange the order in which the clips are to be displayed in 

the cdiicd output video sequence. In the present example, this can be achieved using the "drag-and-drop" mechanism 
simiLir to that which is standard to the Microsoft Windows version 3.1 operating system. Using this mechanism, the 
user can position the display screen cursor over a clip icon to be moved, and then press and hofci the mouse button. 

11 :he cursor is then moved while the mouse button is pressed and held, the icon is "dragged" with the cursor to a new 
-f^ posfion I nc mouse button is released to "drop" the clip icon at the new position. 

for example the clip k:on 30B could be dragged and dropped to a position between the clip icons 30C and SOD. 
Thus the order of the clip icons on the display screen would become ACBD and the output edited sequence would 
ccxnpribe atp A followed by clip C, clip B and finally clip D. 

Tfiu output edited sequence can be viewed by the user as folbws. If the user double-clicks on the clip icon 30A, 
50 then the whole of the portion A will be displayed, followed immediately by the whole of the portion 8, then C and finally 
D The composite sequence ABCD forms the edited output programme. 

I' the user wishes to preview only, say, a latter part of the edited output programme, he could double-click on the 
dp icon 30C: in which case replay would start from the beginning of clip C, to be followed immediately by clip D. 

Further techniques for previewing the output sequence will be described below. 
55 Figure 2 is a schematic block diagram of the edit controller and associated video storage apparatus. 

The edit controller comprises a personal computer (PC) 100 running the Microsoft Windows 3. 1 operating system, 
fho PC having a cursor control device 110 (e.g. a mouse), a display screen memory 120 and a display screen 130. 
The PC in the present embodiment is a notebook computer, the IBM "Thinkpad 760C". in which the PC 100, the cursor 
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control device 110, video display screen memory 120 and the display screen 130 are all incorporated into a single 
portable unit. (In actual fact, the cursor control device 100 in the IBM Thinkpad is a joystick control device, but since 
this is set up to mimic the operation of a mouse, and an external mouse port Is also available on this PC. the term 
"mouse* will be used for convenience as a generic term for a cursor control device in the following description.) 
5 The PC 100 communicates with a video store controller 140 which in turn accesses video and audio data stored 

on a magneto-optical disc 150. In the present embodiment, the video store controller and the MO disc 150 are provided 
within a "docking station", i.e. a box of similar size to the IBM Thinkpad, on which the IBM Thinkpad may rest. 

In operation, a video signal is supplied at an input port 160 of the video store controller and is subjected to a high 
degree of intra-plcture data compression for storage on the MO disc 150. When one or more sections of source video 
10 have been stored on the MO disc 150, they can be manipulated by the user operating the edit controller to generate 
an edit decision list which Is a list of time codes defining "in-points" and "out-points" of the source material for successive 
portions of an output edited video sequence. The edit decision list can then be applied to the original video data as 
supplied to the video store controller 140, for broadcast or distribution. 

Figures 3Ato 3C schematically illustrate source video files, and Figure 3D schematically illustrates an edited output 
15 video sequence. In ail of Figures 3A to 3D, time is represented on a horizontal axis from left to right. 

The output video sequence of Figure 3D is formed of successive portions or clips of the source files of Figures 
' 3B, 3A and then 3C. These are joined together contiguously by "cut" edits. 

In use, in order to generate one of the clips from a source file, the user would replay that source file in the viewer 
window until a suitable in-point, tj^ was located, the user would operate a particular key or click on a cursor control on 
20 ihe screen (not shown). The user would then continue the replay of the source file until a suitable out-point was found, 
and then operate the appropriate control to define that out-potnt. 

An entry in the edit decision list (see below) would then be created, along with a corresponding clip icon (see 
below). The newly created EDL entry and clip icon would be placed as a new temporally last item in the sequence of 
clips already prepared. However, this temporal order can easily be altered, as described below. 
25 Figures 4A to 4C schematically illustrate the logical relationship between clip Icons 30, an edit decision list (Figure 

4B) and data representing the source video files (Figure 4A). 

Each of the schematic boxes 200 in Figure 4A represents a file header or directory entry for a file on the MO disc 
150 corresponding to a section of source video. The directory entry includes file information such as a title, a starting 
time code and a finishing time code. Each such directory entry is associated with a single source icon 20 on the display 
30 screen of Figure 1 . 

The boxes 210 of Figure 4B schennatically illustrate entries in an edit decision list. Each such entry relates to one 
contiguous portion of the output video sequence derived from a single one of the source video files. The entry contains 
information defining one of the source video files and a corresponding "Reel ID" defining the origin of the source file 
(e.g. a reel of video tape), an offset start variable defining the first picture of the sequence to be taken from that source 

55 video file, a duration variable defining the duration of the portion to be used from that source video file, and two com- 
pressed pictures: an in picture and an out picture. These compressed pictures are accessed from the data correspond- 
ing to their source file stored on the MO disc 150 when the EDL item Is first created. 

All of the times relating to in-points, out-points , offsets and durations are expressed in the standard video timecode 
format HH:MM:SS:FF (hours: minutes: seconds: frames) 

^0 The edit decision list for the example of Figures 3a to 3d therefore stores the folbwing data: 
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EDL item 1 


File ID: B 




Reel ID: reel 1 




offset (B) 




duration (B) 




picture at 




picture at t^^^B) 


EDL item 2 


FUe ID: A 




Reel ID: reel 2 




offset (A) 




duration (A) 




picture at ti„(A) 




picture at to„,(A) 



EDL item 3 


FUe ID: C 




Reel ED: reel 3 




offset (C) 




duration (C) 




picture at ti^o 




picture at t^^c) 







where duration(A) is equal to (Iou,(A) " tin(A))- 

On replay of the output edited sequence, a linked list ot storage locations on the disk is created by the PC and 
iransnnined to the video store controller to define the trannes necessary for the output edited sequence. This linked list 
is also stored on the disk so thai it can be accessed later if required, even in a later editing session. 

The same replay mechanism is used to replay a source file, in that a linked list of storage locations on the MO disk 
so is derived by the PC 100 reference to the source file header and is transmitted to the video store controller, which then 
reads the frames at those storage locations in the appropriate order for replay. Shuttle replay is also possible by re- 
playing the frames at a higher rate or by replaying only, say, 1 in n of the frames to achieve the desired shuttle speed. 

To create the linked list of storage locations for an output edited sequence, first, the directory entry for file B is 
accessed and the starting timecode of file B is read from the directory entry. The offset variable, offset{B) is added to 
ss the starting timecode to calculate an in-point for this clip. The duration variable, duration(B) is added to the timecode 
of the in-point to calculate an out-point for the clip. The file address information stored in the directory entry (basically 
a linked list of data items or "clusters" on the MO disk 150) is accessed to determine which cluster holds the picture 
corresponding to the required in-point. The appropriate cluster for the in-point picture is specified as the first cluster 
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for the current clip, and, following the existing linked list of clusters defined by the directory entry, successive storage 
locations are defined until the out-point for that clip is reached. 

When the out-point for file B is reached, the process is repeated for the next clip (fronn file A in this example), and 
so on. 

s The linked list of storage addresses corresponding to the output edited sequence is referred to as a Virtual" file, 

and it can be replayed without further reference to the directory entries to the source files. Replay can be started at a 
point within the virtual file by simply cueing to the appropriate number of frames along the linked list of storage locations. 

Referring to Figures 4a to 4c, therefore, each of the directory entries 200 corresponds to and defines the position 
on the MO disk 150 of a source video file. Each of the EDL items 210 corresponds to and defines an output clip, with 
10 reference to the directory entry 200 for the source file containing that clip. 

In addition, each EDL item 21 0 corresponds to a respective clip icon 30 (as shown in Figure 4c). The display order 
of the clip icons 30 from left to right (and into second and subsequent rows from left to right if required) in turn defines 
the order of the EDL items in the finked list of EDL items. The way in which this is achieved will be described below. 
As mentioned above, the clip icons can be re-ordered by a drag-and-drop mechanism. To do this, the user moves 
75 the cursor onto one of the clip icons and presses and holds the mouse button. Then, as long as the mouse button 
remains held down, that clip icon (or at least a representative schematic outline of it) is "dragged" with the cursor. 
Wherever the dragged icon is on the screen when the mouse button is released then defines a new position of that 
clip icon. 

In fact, in common with many existing uses of the drag-and-drop type of mechanism, the dragged icon in this 
20 system is not allowed to drop into any position in the output area of the screen. Instead, it is constrained to fall to a 
position on a defined grid of possible positions so that the resulting pattern of icons is equally spaced and without any 
missing icons, in horizontal rows from top left to bottom right. (This feature may be seen when program icons are moved 
within a program group under program manager in Microsoft Windows 3.1, with the "auto arrange icons" option ena- 
bled). 

25 At the end of a drag-and drop operation, if the order of the clip icons has been changed, then the assignments 

between the child windows and the EDL items are correspondingly altered. 

The above features are achieved by the way in which a computer programme is written to run under the Microsoft 

Windows 3,1 operating system. Many of the basic techniques necessary for an understanding of this are described in 

the book, "Programming Windows 3.1'. Charles Petzold, Microsoft Press, third edition, 1992. 
30 The EDL items and directory entries are maintained as normal variable strtjctures in a conventional way. The 

directory entries in fact form a linked list, but this is not important to the present techniques. 

The output area is a window, and the clip icons are so-called "child windows" operating under the parent window 

of the output area Thus, although the clip icons appear to be just small icon-like graphical images, they do have some 

additional functionality as child windows themselves. So, in this description, the word "icon" is used in a broad sense 
35 to mean a graphical representation of a windows program and/ora piece of audio or video material, in so far as selecting. 

clicking on or moving the icon on the screen has an effect on the corresponding program or piece of audio or video 

material. 

One such child window (clip icon) exists for each entry in the EDL. When the child window is painted or repainted 
by the Windows operating system, it displays either the in-picture or the out-picture from that EDL item. The choice of 
40 which of the two pictures is displayed is left to the user, through cursor buttons on the child window (not shown). 

When the user clicks or double-clicks on a child window, Windows sends a message to that child window. In the 
case of a replay operation, a double click on a child window causes the child window program to communicate the 
location of the click or double click to the parent window which in turn initiates replay of the video material corresponding 
to the selected child window. 

4S Figure 5 schematically illustrates cursor mapping within an output area of the display screen of Figure 1 . The output 

area surrounding the clip icons is notionally divided into first regions 250 overlying a central area of each clip icon, and 
second regions 

When a double click of the mouse button is detected, the coordinates of the mouse cursor at that time (which are 
passed to the parent window either directly or via the chiteJ window, depending on whether the mouse cursor is within 
so a child window at the time) are compared with coordinate ranges defining the first and second regions 250, 260. 

If the cursor coordinates are within one of the first regions 250, then the video replay is initiated by the parent 
window from the start of the clip corresponding to the clip icon under that first region 250. 

If the cursor coordinates are within a second regk)n 260, then the parent window initiates video replay from the 
clip immediately to the left of the selected region 260, but from a predetermined time before the end of the clip. For 
55 example, the predetermined time might be 3 seconds before the end of that clip, but preferably this period can be set 
by the user. This allows the edit transition between that clip and the next to be reviewed by the user 

The time at which to start (or cue up) replay is calculated as follows: 
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replay start timecode = starting TC for output (virtual) file 
+ lengths of preceding clips (if any) 
+ duration of current clip 
- predetermined time period 

However, if the duration of the clip is less than the predetermined time period, replay is initiated from the start of the clip. 

Figure 6 schematically illustrates a second type of cursor mapping within the output area of the display screen of 
Figure 1. Here, further regions are notionally defined by ranges of cursor coordinates, for use during a drag-and-drop 
operation. 

During such an operation, the cursor coordinates (in the parent window) are continuously (repeatedly) checked 
against coordinate ranges defining "left" regions and "nght" regions 280 about each clip icon. In the example shown, 
one left region and one right region overlie each clip icon, and so during the drag and drop operation if the cursor is 
detected to be in either of those two regions, it is thereby detected that that is the nearest icon to the current cursor 
position. 

The left and right regions can then be used to detect and indicate which side of the detected nearest icon the 
dragged icon would fall, if released then. Basically, if the cursor is in a left region, the dragged icon would fall to the 
left of the detected nearest icon. If the cursor is in a right region, the dragged icon would fall to the right of the detected 
nearest icon. 

This detection can then be used to display an indication of which side of the detected nearest icon the dragged 
icon will fall. 

Figures 7a to 7c schematically illustrate different cursor types during a drag and drop operation. 

When the cursor is in a left region 270, the cursor is changed (using a standard Windows cursor change routine) 
to the cursor of Figure 7a. Similarly, when the cursor is in a right region, the cursor is changed to the cursor of Figure 
7b. The cursor of Figure 7c indicates that the cursor is in neither a left nor a right region (and indeed it may be outside 
the parent window), and so it is not a valid place to drop the dragged icon. If the icon is dropped there, then it is either 
dropped at the end of the existing icon order (if still within the parent window) or^'the order of the icons in the parent 
window will not change (if outside the parent window). 

Figures 8a and 8b schematically illustrate the use of the different cursor types. 

In Figure 8a, the cursor is slightly to the left of an underlying clip icon 30, and so the left arrow cursor is displayed 
to give a clear indication to the user that the dragged icon will fall to the left of the underlying icon. Similarly, the situation 
is reversed in Figure 8b. Thus a clear indication is given to the user of which side the dragged icon will fall. 

In an alternative embodiment, the arrow-like indication could be placed over the detected nearest icon, rather than 
using a modification of the cursor itself. 

Figure 9 schematically illustrates a shuttle control operation in a viewer window of the display screen of Figure 1 , 
and Figure 10 is a schematic graph of shuttle speed against cursor displacement. 

When the cursor is placed within the viewer window and the mouse button clicked and held, the viewer window 
initiates shuttle replay of the video material currently associated with the viewer window (depending on the last icon 
selected by the user, this could be an output clip or a source file). 

In fact, this is defined as a two-stage process. When the mouse button is first pressed within the viewer window, 
(whether or not it is subsequently held down), the Windows "mouse down" message causes the Viewer window to 
issue a "stop" command to stop replay. Then, if the mouse button has not been released within a predetermined time 
(e.g. 0.5 seconds), as detected by recording the Windows timer at the time of the first mouse down message, shuttle 
operation is selected. Alternatively, if a double click is detected (i.e. a release and then a second click within a prede- 
termined time) normal speed replay is initiated by the viewer window. 

The viewer window temporarily "captures" the mouse as long as the button is held down - a standard Windows 
technique. The coordinates in the viewer window of the point at which the mouse button is first clicked (Xj, y|) are stored, 
and the coordinates of the cursor at intervals thereafter (x^, yc) are compared with (x,, y,). 

The shuttle speed is set to be dependent on the current value of: 
Ixc - X|l i.e. on the horizontal component 302 of the distance 300 from the initial activation point to the current 
cursor position. However, this value does not in itself specify the shuttle speed; instead, there is a generally exponential 
relationship between the horizontal displacement component and the shuttle speed up to a maximum shuttle speed, 
as illustrated schematically in Figure 10. This relationship is achieved by the value \xq - x,l actually providing an index 
into a look-up table (e.g. in read-only-memory) defining shuttle speed values in response to different horizontal dis- 
placement component values. 
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The look-up table values can be selected or scaled so that a distance equal to, say, the width of the viewer window 
causes shuttle operation at the maxirrium available shuttle speed for the replay device being controlled. 

As a further check, if Xc > X| then the cursor is nowto the right of its initial position, and so forward shuttle operation 
is selected. Otherwise, reverse shuttle operation is selected. Thus, the sign of I Xq - x, I dictates the direction of shuttle 
operation. 

When the mouse button is released, shuttle operation is maintained at the currently selected shuttle speed and 
direction. Shuttle operation can then be stopped by a single mouse click within the viewer window, which causes the 
"stop" command to be issued as mentioned above. 



Claims 

1. An edit controller for controlling editing of recorded audio and/or video material, in which temporally successive 
material clips of a edited output material sequence are represented by corresponding clip icons on a display screen, 
the controller comprising: 

cursor control means for providing user control of a cursor on the display screen; 

selection control means for selecting an operation to be performed by the edit controller in dependence on 
the current position of the cursor on the display screen when the selection control means is activated by the 
user; 

means for defining first and second display screen selectbn areas for each clip icon, the first display screen 
selection area having a predefined position on the display screen with respect to a current display position of 
the respective clip icon and the second display screen selection area having a predefined position with respect 
to a current display position of the respective clip icon and/or the next clip icon in the temporal replay order; 
means, responsive to user operation of the selection control means while the cursor is displayed within the 
first selection area associated with a clip icon for initiating replay of the output material sequence from the 
start of the material clip corresponding to that clip icon: and 

means, responsive to user operation of the selection control means while the cursor is displayed within the 
second selection area associated with a clip icon for initiating replay of the output material sequence from a 
point within the material clip corresponding to^that clip icon which is a predetermined time before the end of 
that material clip. 

2. An edit controller according to claim 1 , in which the clip icons are displayed in temporal order along a predetermined 
screen direction. 

3. An edit controller according to claim 2, in which the predetemiined screen direction is a horizontal screen direction. 

4. An edit controller according to any one of the preceding claims, in which the first selection area overlies the centre 
of the corresponding clip icon. 

5. An edit controller according to any one of the preceding claims^ in which the second selection area is at least 
partially disposed between the corresponding clip icon and the temporally following clip icon. 

6. An edit controller according to claim 5, in which the second selection area overlies an edge region of the corre- 
sponding clip icon and/or an edge region of the temporally following clip icon. 

7. An edit controller according to any one of the preceding claims, comprising means for displaying a respective 
different cursor when the cursor is positioned within the first and the second screen selection areas. 

8. An edit controller according to any one of the preceding claims, in which: 

the cursor control means comprises a mouse, trackerball or joystick; and 

the selection control means comprises a mouse button, a trackerball button or a joystick button respectively. 

9. A method of operation of an edit controller, in which temporally successive audio and/or video material clips of a 
edited output material sequence are represented by corresponding clip icons on a display screen, the controller 
comprising cursor control means for providing user control of a cursor on the display screen; and selection control 
means for selecting an operation to be performed by the edit controller in dependence on the current position of 
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the cursor on the display screen when the selection control means is activated by the user; the method comprising: 

defining first and second display screen selection areas for each clip icon, the first display screen selection 
area having a predefined position on the display screen with respect to a current display position of the re- 
spective clip icon and the second display screen selection area having a predefined position with respect to 
a current display position of the respective clip icon and/or the next clip icon in the temporal replay order; 
initiating replay of the output material sequence, in response to user operation of the selection control means 
while the cursor is displayed within the first selection area associated with a clip icon, from the start of the 
material clip corresponding to that clip icon; and 

initiating replay of the output material sequence, in response to user operation of the selection control means 
while the cursor is displayed within the second selection area associated with a clip icon, from a point within 
the material clip corresponding to that clip icon which is a predetermined time before the end of that material 
clip. 



9 



EP 0 801 389 A2 



a> 




o C 




our 

icoi 




V) 


— o 






" V 




0) 




<i> 


p c 




o c 






our 

icoi 


CO 




CO 



CD 




O 


cr 


our 

\^ V* t 


ico 


CO 







10 



EP 0 801 389 A2 



O 
CO 



CO (1) 

.SQ o 

"O CO 







cursor 
control 
device 







Co 0) o 

0.03 E 

.£2 0 0) 

TO w g 



t/) 

o 
c 



+ 
o 

CL 




11 



EP 0 801 389 A2 




12 

:iD:<EP Oe01389A2 I > 



EP 0 801 389 A2 



200 



directory 
for source 
file A 



directory 
for source 
file B 



. . . c 



Fig. 4a 



30 



7 




EDL 
item 1 



210 



EDL 
item 2 



Fig. 4b 



13 



EP 0 801 389 A2 




Fig. 5 







i 


i 




r" 




i 

i 

1 

i 


! 
1 
t 
t 

i 

i 
1 
1 






1 

i 
1 

[ 

i 

i 

j 
1 












\ 


— ,_.Jl 


— . — i , _ 


1 

L__ _.i . 1 


.... i 





270 280 270 280 270 280 270 280 



Fig. 6 



14 



EP 0 801 389 A2 





Fig. 7a Fig. 7b 



Fig. 7c 




30 



30 




Fig. 8a 



Fig. 8b 



shuttle back 



(x,,y,) 



shuttle forward 




302 



Fig. 9 



15 



This Page Blank (uspfo) 



t 



(19) 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(88) Date of publication A3: 

03.03.1999 Bulletin 1999/09 

(43) Date of publication A2: 

15.10.1997 Bulletin 1997/42 

(21) Application number: 97301526.6 

(22) Date of filing: 07.03.1997 



(11) EP 0 801 389 

EUROPEAN PATENT APPLICATION 

(51) intciA G11B 27/034, G06F 3/033 



(84) 


Designated Contracting States: 


(72) 


Inventor: McGrath, Rflark John 




DE FR 




Bracknell, Berkshire RG12 3HH (GB) 


(30) 


Priority: 12.04.1996 GB 9607640 


(74) 


Representative: Turner, James Arthur et al 








D. Young & Co., 


(71) 


Applicant: Sony United Kingdom Limited 




21 New Fetter Lane 




Weybridge, Surrey KT13 OXW (GB) 




London EC4A IDA (GB) 



(54) Editing of recorded material 

(57) An edit controller for controlling editing of re- 
corded audio and/or video material, in which temporally 
successive material clips of a edited output material se- 
quence are represented by corresponding clip icons on 
a display screen, comprises cursor control means for 
providing user control of a cursor on the display screen; 
selection control means for selecting an operation to be 
performed by the edit controller in dependence on the 
current position of the cursor on the display screen when 
the selection control means is activated by the user; 
means for defining first and second display screen se- 
lection areas (250,250) for each clip icon, the first and 
second display screen selection areas (250,260) each 



having a predefined position on the display screen with 
respect to a current display position of the respective 
clip icon; means, responsive to user operation of the se- 
lection control means while the cursor is displayed with- 
in the first selection area (260) associated with a clip 
icon for initiating replay of the output material sequence 
from the start of the material clip corresponding to that 
clip icon; and means, responsive to user operation of 
the selection control means while the cursor Is displayed 
within the second selection area (250) associated with 
a clip icon for initiating replay of the output material se- 
quence from a point within the material clip correspond- 
ing to that clip icon which Is a predetermined time before 
the end of that material clip. 



yj 




Fig. 5 



Prhted by Jouve. 75001 PARIS (FH) 



EP 0 801 389 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 97 30 1526 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Crtation ol document writh indication, where appropriate. 
of relevant passages ' 



Relevant 
to claim 



CLASSIFICATtON THE 
APPUCATION (lm.Cl.6) 



P. A 



9 
I 

2 

3, 



KA2UAKI TANAKA ET AL: "INTELLIGENT ROUGH 
VIDEO EDITING SYSTEM" 
HITACHI REVIEW. 

vol. 44, no. 4, 1 August 1995, pages 
217-220, XP000550273 

* the whole document * 

EP 0 564 247 A (ADOBE SYSTEMS INC) 
!6 October 1993 

* figure 10 * 

EP 0 113 993 A (MONTAGE COMPUTER CORP) 
25 July 1984 

j* page 5, line 22 - page 6. line 5 * 

US 5 237 648 A (MILLS MICHAEL ET AL) 
17 August 1993 
1 ♦ column 6, line 3-29 * 

EP 0 737 978 A (QUANTEL LTD) 
16 October 1996 

* the whole document * 



1-3,9 



G11B27/034 
G06F3/033 



1-3,9 



1-3,9 



1,2,9 



1,2,9 



TECHNICAL RELDS 
SEARCHED (lnt.Cl.6) 



GllB 

G06F 



The present search report has been drawn up tor all claims 

Ptac« at Maiiti 



THE HAGUE 



Dst« ot conptetfon ot the so»teh 

18 December 1998 



_L 



Eicsfnin»r 

Mourik, J 



CATEGORY OF CITED DOCUMENTS 

X : Fhaftfoilarty rstaVAnt B takon aJono 

Y partkutarty rotavant if combined wtttt anottw 

docuTTMnt ot the sarrM eatdgoiy 
A tectmotogteai t>acfc^t>und 
O : non<^tfrittftn dtsdosur* 
P inienn©<fiata <*ocun>ent 



T : thoofv or principle undertyog the invention 
E : eartter patent document, but pU)fisna<t on, or 

after ttte Tiltng date 
D : document dted in ttie application 
L : document ctted tor other reasons 



& : member of ttM seme patent lamJIy, conesponding 
document 



ID: <EP oaoi?n.QA:4 I 



2 



EP 0 801 389 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 97 30 1526 



This annex lists ttie pat&nt family members relating to the patent documents cited in the atxxve-mentioned European search raport 
The members are as contair»ed in the European Patent Office EDP file on 

The European Patent Office is in no way liable (or these particulars which are merely given for the purpose ol inlornrtalion. 

18-12-1998 



Patent document 




Publication 




Patent family 




Publication 


cited in search report 




date 




member(3) 




date 


EP 0564247 


A 


06-10-1993 


CA 


2093313 


A 


04-10-1993 








DE 


69320516 


0 


01-10-1998 








JP 


7046462 


A 


14-02-1995 




A 

M 




lie 


4 CO on Dp 
*4DoO loo 


A 










us 


4937685 


A 


26-06-1990 








US 


4685003 


A 


04-08-1987 








US 


4979050 


A 


18-12-1990 








AU 


601671 


B 


20-09-1990 








AU 


2431084 


A 


17-07-1984 








CA 


1217559 


A 


03-02-1987 








JP 


2733502 


8 


30-03-1998 








WO 


8402606 


A 


05-07-1984 








US 


5532830 


A 


02-07-1996 








us 


5517320 


A 


14-05-1996 








US 


4939594 


A 


03-07-1990 








us 


5477337 


A 


19-12-1995 


1 






CA 


1292564 


A 


26-11-1991 


i 






us 


4949193 


A 


14-08-1990 


1 






CA 


1292563 


A 


26-11-1991 


i 






us 


4943866 


A 


24-07-1990 








us 


4964004 


A 


16-10-1990 


US 5237648 

t 


A 


17-08-1993 


NONE 








EP 0737978 


A 


16-10-1996 


GB 


2300535 


A 


06-11-1996 


I * 






JP 


9098380 A 


08-04-1997 



I 

i 



£ For more details about This annex : see Official Journal of tt>e European Patent Ofiibe, Mo. 12/82 



